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Introduction 


Let X be a random variable having probability distribution P(X/0), 0&6. It is 
desired to test H,:0 e O, against H,:0€ O, =O-O,. Let S denote the sample space of 
outcomes of an experiment and x =(x,,x,,-—~—,x,,) denote an arbitrary element of S. A test 


procedure consists in diving the sample space into two regions W and S — W and deciding to 


reject Ho if the observed x e W. The region W is called the critical region. The function 


yY(0) =P,( x e W)= P,(W), say, is called the power function of the test. 


We consider first the case where ©, consists of a single element, 0, and its 
complement ©, also has a single element 0,. We want to test the simple hypothesis 


Ho: 0-0, against the simple alternative hypothesis H; : 0 —0,. 


Let Lo = L(X/Ho) and Li = L(X/Hi) be the likelihood functions under Ho and H; 


respectively. In the Neyman — Pearson set up the problem is to determine a critical region W 


such that 
Y(0,) = P4, (W) = [Lodx =O, an assigned value (1) 
and Y(8,) =P, (W) = [Lidx is maximum (2) 


compared to all other critical regions satisfying (1). 


If such a critical region exists it is called the most powerful critical region of level a. 


By the Neyman-Pearson lemma the most powerful critical region Wo for testing Hp: 8 = 05 


against H4:0 = 0, is given by 


W, ={x:L,2kL,} 


provided there exists a k such that (1) is satisfied. 


For this test y(0,) 2 à and y(8,) —^1asn >a. 


But for any good test we must have y(0,) — 0 and y(0,) —1 as n — o» because complete 


discrimination between the hypotheses Ho and H; should be possible as the sample size 


becomes indefinitely large. 


Thus for a good test it is required that the two error probabilities a and B should 


depend on the sample size n and both should tend to zero as n => œ. 


We describe below test procedures which are optimum in the sense that they 
minimize the sum of the two error probabilities as compared to any other test. Note that 


minimizing (a +B ) is equivalent to maximising 





1 - (a+B8)= (1-p)-a = Power- Size. 


Thus an optimum test maximises the difference of power and size as compared to any other 


test. 


Definition 1 : A critical region Wo will be called optimum if 


[Lidx — [L,dx > f L,dx - f L,dx (3) 


for every other critical region W. 
Lemma 1: For testing Ho: 0 — 0, against Hı : 0—0, the region 
W,={x: L, 2L,} is optimum. 


Proof : Wo is such that inside Wo, L,2L, and outside Wo, L; < Lọ. Let W be any other 


critical region. 





[L -L)dx - | L, - 1, )dx 


Wo 


= f (L, -L,)dx - [(L, -Lo)dx, 


WNW: wnw¢s 


by subtracting the integrals over the common region Wo N W. 


since the integrand of first integral is positive and the integrand under second integral is 


negative. 
Hence (3) is satisfied and Wo is an optimum critical region. 
Example 1 : 

Consider a normal population N(0,6?) where o? is known. 
It is desired to test Ho: 0 — 0, against Hı : 0-0, , 0, 5 6,. 
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The optimum test rejects Ho 
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Thus the optimum test rejects Ho 
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Here a=f. 
It can be seen that a =ßB— 0 asn o. 
Example 2 : For testing Ho: 0-0, against Hı : 0-0, , 04 «06, the optimum test rejects 


0140 
Ho when x<., 


Example 3 : Consider a normal distribution Nlo, o? ) 0 known. 


It is desired to test Ho: 6? = có against H1 : o? = 62,0 > oj. 
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The optimum test rejects Ho 
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Thus the optimum test rejects Ho if X (= 2) > ne. 
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Note that under Hy : 





2 
follows N(0,1) distribution. Hence » follows, under 
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Ho, a chi-square distribution with n degrees of freedom (d.f.). 
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Note that under H1, Y e 
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) follows a chi-square distribution with n d.f. 
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It can be seen thata > O and p >0 asn > œ. 


Example 4 : Let X follow the exponential family distributions 
£(x/0) = c(0)e OT n(x) 
It is desired to test Ho: 0 — 0, against Hı : 0 —0, 


L(x/0) = [c9] e9(9Z TG) T Tn(x,) 


The optimum test rejects Ho when 
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Locally Optimum Tests: 


Let the random variable X have probability distribution P(x/0). We are interested in 
testing Ho: 0 20, against Hı : 0209 . If W is any critical region then the power of the test 


as a function of @ is 


y(8) = Po(W) = fy L(X/0)dx 


We want to determine a region W for which 


y(8) — Y(69) = fy L(x/8)dx — fp L(x/0) 
is a maximum. 


When a uniformly optimum region does not exist, there is not a single region which is 
best for all alternatives. We may, however, find regions which are best for alternatives close 
to the null hypothesis and hope that such regions will also do well for distant alternatives. We 


shall call such regions locally optimum regions. 


Let y (0) admit Taylor expansion about the point 0 = 6). Then 
y(8) = y(809) + (0 — 85) (09) + 6 where 6 > 0 as 0 0g 
yY(8) — y(69) = (8 — 69)$ (89) + 6 
If |8 — 8| is small y (0) — y(09) is maximised when y(05)is maximised. 
Definition2 : A region Wo will be called a locally optimum critical region if 
lj L(x/09)dx = f, L(x/09)dx (4) 
For every other critical region W. 


Lemma 2 : Let Wo be the region (x: L(x/0,) = L(x/ 05)]. Then Wo is locally optimum. 


Proof: Let Wo be the region such that inside it £(x/09) 2 L(x/09) and outside it 


Í(x/09) < L(x/09). Let W be any other region. 
Sw, E(x / Oo) dx — f, L(x/09)dx 
i dues L(x/09)dx e Swenw L@&/8o) dx 


7 Jw, we L(x/8o)dx + Sweuw L(x/09)dx (*) 


IV 


Sw, ye LG 09) AX + fusus LGc/ 09) dx 


since L(x/@9) 2 L(x/09) inside both the regions of the integrals. 


20, since L(x/09) 20 inall the regions. 
Hence Se L(x/09)dx 2 f, L(x/0o)dx for every other region W. 
To prove (*): 
We have in L(x/09)dx + Jos L(x/09)dx = 1 for every region R. 


Differentiating we have 


| LG/69x + | Í(x/09)dx = 0 
R RC 


| Í(x/09)dx = -f Í(x/09)dx = 0 
R RC 


In (5), take R°=W§ n W and the relation is proved. 


Similarly if the alternatives are Hı : 0 «09 , the locally optimum critical region is 


{x: L(x/09) € L(x/8,)]. 
Example 5: Consider N(0, 0?) distribution, o? known. 


It is desired to test Ho: 0 — 0, against Hı : 0500 
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Exercise: If 0; = 10,04 = 11,0 =2,n=16,then «= 0.3085, 1-8 = 0.9337 


Power - Size = 0.6252 
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oO 


vn 





If we reject Ho when > 1.64, then a=0.05, 1-8 — 0.6406 


Power — Size = 0.5906 


Hence Power — Size of locally optimum test is greater than Power — size of the usual test. 


Locally Optimum Unbiased Test: 


Let the random variable X follows the probability distribution P(x/0). Suppose it is 


desired to test Ho: 0 — 0, against H;: 009 . We impose the unbiasedness restriction 
yY(8) = y(69), 8 * 6o 


and y(@) — y(09) is a maximum as compared to all other regions. If such a region does not 


exist we impose the unbiasedness restriction y (09) = 0. 


Let y(@) admit Taylor expansion about the point 0 = Oo. 


0.2 
Then y(8) = y(6,) + (6 — ) (89) + —* y"(00)+n 


where 7 > 0 as 0-0. 


y(8) — y(&) = (8 — 6/65) + E= "(09 )+n 


Under the unbiasedness restriction y(09) ^ 0, if |@ — Oo] is small y(0) — y(09) is 


maximised when y"(0o ) is maximised. 


Definition 3: A region Wo will be called a locally optimum unbiased region if 
¥(8) = Sy, b Gc/09)dx =0 


and — y'(69) = [L"(X/®o x > [L"(X/0p jix 
Wo W 


for all other regions W satisfying (5). 
Lemma 3 : Let Wo be the region Íx:L'(x/05)2 L(x/09)) 


Then Wo is locally optimum unbiased. 


Proof: Let W be any other region 


fu, Li" Go/8)dx — fy L(x /Oq)dx 


= | we/ayax+ | u'e/oax 


WonW* W$nW 


by subtracting the common area of W and Wo. 


(5) 


(6) 


= | 1" (x/0,)dx + | 1" (x/0,)dx, 


WonW* Wy nw! 


since L'(x/09) = L(x/@) inside Wo and outside W. 
> 0 since L(x/@)= 0. 
Example 6: 
Consider N(0,0?) distribution, o? known . 


Hg: 0 = 06, H4:0 * Oo 
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Locally optimum unbiased test rejects Ho 
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Under Ho, follows yc) distribution. 


Testing Mean of a normal population when variance is unknown. 
Consider N(6, o?) distribution, o? known. 


For testing Ho: 0 — 0, against Hi: 0-0, the critical function of the optimum test is 


given by 


Pm) = b if L(x/0,) = L(x/0,) 


0 otherwise 


On simplification we get 


Oo + 06, 





$a x) = h if x2 if 4 > Uo 


0 otherwise 


Bg dr. 
ao =f} ifx« 2 if Uy < Ho 


0 otherwise 





Consider the case when o? is unknown. 


For this case we propose a test which rejects Ho when 


L(x/01) 
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where 1(x/0;), (i=0,1) is the maximum of the likelihood under Hj obtained from L(x/0;) 


by replacing o? by its maximum likelihood estimate 


— 


1 3^ 
o2 = > HMET — 0j) ; 170,1. 
Let p(x) denote the critical function of the proposed test, then 


p(x) = fi if LO/0,) 21/05) 


0 otherwise 
On simplification we get 
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$, G0 =! ifx> if 0, > 0 
o otherwsie 
lifx« Ata 


0 otherwsie 





za $62 - | if 0, < 0, 


Thus the proposed test $, (x) is equivalent to m(x) which is the optimum test that 
minimizes the sum of two error probabilities (a + P). Thus we see that one gets the same test 
which minimises the sum of the two error probabilities irrespective of whether o? is known 


or unknown. 
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